Gestalt assessment of online educational resources may not be sufficiently reliable and consistent
نویسندگان
چکیده
PURPOSE Online open educational resources are increasingly used in medical education, particularly blogs and podcasts. However, it is unclear whether these resources can be adequately appraised by end-users. Our goal was to determine whether gestalt-based recommendations are sufficient for emergency medicine trainees and attending physicians to reliably recommend online educational resources to others. METHODS Raters (33 trainees and 21 attendings in emergency medicine from North America) were asked to rate 40 blog posts according to whether, based on their gestalt, they would recommend the resource to (1) a trainee or (2) an attending physician. The ratings' reliability was assessed using intraclass correlation coefficients (ICC). Associations between groups' mean scores were assessed using Pearson's r. A repeated measures analysis of variance (RM-ANOVA) was completed to determine the effect of the level of training on gestalt recommendation scale (i. e. trainee vs. attending). RESULTS Trainees demonstrated poor reliability when recommending resources for other trainees (ICC = 0.21, 95% CI 0.13-0.39) and attendings (ICC = 0.16, 95% CI = 0.09-0.30). Similarly, attendings had poor reliability when recommending resources for trainees (ICC = 0.27, 95% CI 0.18-0.41) and other attendings (ICC = 0.22, 95% CI 0.14-0.35). There were moderate correlations between the mean scores for each blog post when either trainees or attendings considered the same target audience. The RM-ANOVA also corroborated that there is a main effect of the proposed target audience on the ratings by both trainees and attendings. CONCLUSIONS A gestalt-based rating system is not sufficiently reliable when recommending online educational resources to trainees and attendings. Trainees' gestalt ratings for recommending resources for both groups were especially unreliable. Our findings suggest the need for structured rating systems to rate online educational resources.
منابع مشابه
Online formative assessments: exploring their educational value
Introduction: Online formative assessments (OFA’s) have beenincreasingly recognised in medical education as resources thatpromote self-directed learning. Formative assessments are usedto support the self-directed learning of students. Online formativeassessments have been identified to be less time consuming withautomated feedback. This pilot study aimed to determine whetherparticipation and pe...
متن کاملOnline survey software as a data collection tool for medical education: A case study on lesson plan assessment
Background: There are no general strategies or tools to evaluate daily lesson plans; however, assessments conducted using traditional methods usually include course plans. This study aimed to evaluate the strengths and weaknesses of online survey software in collecting data on education in medical fields and the application of such softwares to evaluate students' views and modification of lesso...
متن کاملInvestigating Gestalt-based Play Therapy on Anxiety and Loneliness in Female Children Labour With Sexual Abuse: a Single Case Research Design (SCRD)
Background: Sexual abuse and harassment are among the major threats to labor children, especially girls, which can be associated with anxiety and loneliness. The current study aimed to investigate the effect of Gestalt play therapy on anxiety and loneliness in Afghan female labor children with sexual abuse histories. Methods: This was a Single Case Research Design (SCRD) study of the AB model....
متن کاملThe Effectiveness of Gestalt Therapy Exclusively and in Combination with Cognitive-behavioral Therapy on Hope and Pain Intensity in Women with Breast Cancer
Background: Breast is a sensitive organ for women. In addition to pain, breast cancer can cause many psychological problems for the patient. The aim of this study was to compare the effectiveness of Gestalt Therapy (GT) and Gestalt therapy combined with Cognitive-Behavioral Therapy (GT-CBT) on the hope and pain intensity of women with breast cancer. Methods: It was a quasi-experimental study w...
متن کاملDerivation of Two Critical Appraisal Scores for Trainees to Evaluate Online Educational Resources: A METRIQ Study
INTRODUCTION Online education resources (OERs), like blogs and podcasts, increasingly augment or replace traditional medical education resources such as textbooks and lectures. Trainees' ability to evaluate these resources is poor, and few quality assessment aids have been developed to assist them. This study aimed to derive a quality evaluation instrument for this purpose. METHODS We used a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره 6 شماره
صفحات -
تاریخ انتشار 2017